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Goal 


>  Apply  time-dependent  reliability/durability 
concepts  to  address  prognostic  CBM  using 

•  Available  data  (limited,  censored) 

•  “Expert”  opinion 

•  Computer  simulations  (physics-of-failure 
data) 
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What  is  Reliability? 

Reliability  at  time  t  is  the  probability  that  the  system 

has  not  failed  before  time  t. 

failure 

1 - 1 - x— — - 

0  t  T 

- ► 

time 

q 

j 

a 

Time-Dependent 

Reliability 

R(t)  =  P(T>t)  =  l-P{T  <t) 

s 

> 
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Background  Information 


First  passage  S  (  X ) 

j  tr  „ _  q  allowable 


Time  t 


Random  Field 


Time  t 


Response(t)  =  f  [  E(t),  Degradation/Wear(t),  Load(t)  ] 


Random  Process  approach  to  reliability-based 
design  is  needed  time-dependent  reliability 


Random 

Process 


Random 

Variable 
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What  can  we  Get  from  Time- 
Dependent  Reliability? 


>  Define  lifecycle  cost  and 
design  for  it. 

>  Use  R(t)  in  CBM  to  determine 
“time  to  maintenance.” 

>  Design  for: 

•  Lifecycle  cost 

•  Quality 

•  Warranty 

•  Maintenance  schedule 


Quality 


Maintenance 
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Definitions  /  Observations 


p‘f  =  p(t  <  tL )  =  Fj  (tL )  Prob.  of  Time  to  Failure 


Cumulative 
Prob.  of  Failure 


Instantaneous  Prob.  of  Failure 


Time-Invariant  Reliability 


Time- Variant  Reliability 


0 

H- 


time 

Ft  (h ) 


* 


0 


b  time 


A 


Ft  {tL  ) 
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Design  for  Lifecycle  Cost 


Lifecycle  Cost  =  Production  Cost 


Quality 


ected  Variable 


[ 


Time-Dependent  System  Reliability 


Accurate  and  efficient  predictive  tools  are  needed  to  estimate  Time- 

dependent  System  Reliability 
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Design  for  Lifecycle  Cost 


C,  (d,  X,  t, ,  r)  =  C,(d,  X)+  C,  (d,  X,  t0 )+  C*  (d,  X,  t. ,  r) 

./  /  \  \ 

Lifecycle  Production  Inspection  ^  Expected 

Cost  Cost  Cost  Variable  Cost 


Final  time  Interest  rate 

N  I 

C\,  (d, Xjf,r)=  \c,{t)e-”f;{t\h 

°f  \ 

Cost  of  failure  PDF  of  time  to 

at  time  t  failure  time 


Fj  (t L )  =  P(3t  e  [0,  tL \  such  that  g{X(t\t)Z0) 
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How  Can  we  Use  it  in  Design? 


>  Specify  a  Desired  System  Reliability  in  Time 


,  L,  X  7  r-  A  7  A 

d,pX’ax 

s*  Fq  (d,  X,  )  —  Pf  {to ) 

F;(d,x,r,)<p'(r1) 

Fdd,X,t ,)<  p‘(t f) 


f 


f 

dL<d<d  u 
M'x,  —  Hx  —  M'x 


x 


<  CK  <  C7 


L 


X 


X 
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How  Can  we  Use  it  in  Design? 


^  Determine  Optimal  Time  to  Maintenance  in  CBM 


max  t 


d,Px’°x 

s.  t.  CL  (d,  jix ,  <tx  ,  tM ,  r) 

F‘(d,X,tM)<\-R' 
dL<d<d  u 
J*xL  —  M^x  —  Hx 
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<  a ,  <  a 
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System  (Vehicle)  Reliability 
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We  Need 


>  A  Tool  to  Estimate  the  PDF  of  Time  Between 
Failures  (TBF)  using  limited,  censored  data 

•  “Frequentist”  approach  (Method  1) 

•  Bayesian  updating  approach  (Method  2) 

S  “Enhances”  data  with  expert  opinion 

>  A  Tool  to  Estimate  System  (Vehicle)  Reliability 


Monte  Carlo  Simulation 
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Reliability  of  Non-Repairable  Systems 


failure 


o 


t 


time 


R{t)  =  p(r  >  t) = 1  -  p{t  <t)^  R{t) = 1  -  f(?) 


(i) 


Mi) 

/ 

F  ailure 
Rate 


_  P(t  <T  <t  +  dt/T  >  t)  _  P(t  <T  <t  +  dt)  _ 


dt 


dt*P{T>t) 


Fjt  +  dt)-F{t) 
dt*R{t ) 


(2) 


UNCLASSIFIED:  Dist  A.  Approved  for  public  release 


14 


> 

Oakland 

LfrftTOTY 


Reliability  of  Non-Repairable  Systems 


failure 


o 


t 


time 


R(t)  =  l-F{t) 


dR 

dt 


due  to  (2) 

-f(,)ld4  =  -X(,)R(,) 


dt 


dR 

R 


=  —  Adt  =>  d(\nR)  =  —Adt  =>  In 


V 


0)) 


l 

=  —  [  Adt 


o 


All  we  need  is  the 
failure  rate 
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Reliability  of  Non-Repairable  Systems 
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Reliability  Calculation 

32 

siHl 

All  we  need  for  calculating  the 
reliability  of  a  system  (non-repairable 
or  repairable)  is  the  system  PDF  of 
time  to  failure  (TTF) 

We  use : 

>  Data  to  estimate  the  PDF  of  TTF  for  each  component 

>  Monte  Carlo  simulation  to  estimate  the  PDF  of  TTF 
for  the  system 
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Estimation  of  the  PDF  (or 
CDF)  of  the  TTF  (TBF)  using 
Limited,  Censored  Data 


>  Two  approaches  will  be  presented: 

•  Censored  MLE  approach  (Method  1) 

•  Bayesian  updating  approach  (Method  2) 

S  “Enhances”  data  with  expert  opinion 
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Limited  Data 


Group  LI 

Original  data  Updated  data 

Vehicle#  mileage  Vehicle#  mileage 


Time  Between  Failures 
(TBF) 


10 

741 

1 

10247 

4 

5273 

2 

9044 

i  i\i  i  ik 

7 

6027 

2 

8977 

i  i\i  i  i  * 

0  6027  \  12011  17384  20000 

5 

7398 

3 

13984 

6 

7495 

3 

4064 

6027  '  \  / 

5984  / 

2 

9044 

4 

5273 

1 

10247 

4 

9747 

8 

12008 

5 

7398 

◄ - ►  / 

5373  / 

7 

12011 

5 

7611 

9 

12014 

6 

7495 

/ 

10 

12074 

6 

7516 

Censoring  Mileage 

3 

13984 

7 

6027 

5 

15009 

7 

5984 

6 

15011 

7 

5373 

4 

15020 

8 

12008 

7 

17384 

9 

12014 

2 

18021 

10 

741 

3 

18048 

10 

11333 
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Censored  MLE  Approach  (Method  1) 


■  Using  available  limited  data  (TBFs  and  censoring  mileage), 
“estimate”  PDF  of  TBF  using  a  censored  MLE  approach. 

■  Tail  sample  the  PDF  of  previous  step  to  “enhance”  the 
original  limited  data. 

■  Using  “enhanced”  data  from  previous  step,  “better 
estimate”  the  PDF  of  TBF  using  an  uncensored  MLE 
approach. 

■  Using  the  PDF  of  previous  step,  a  Bootstrap  approach 
estimates  statistics  of  TBF  (e.g.  distribution  of  MTBF, 
distribution  of  TBF  standard  deviation,  etc.) 
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Bayesian  Updating  Approach  (Method  2) 


■  Use  a  Bayesian  approach  to  estimate  statistics  of  TBF  (e.g. 
distribution  of  MTBF,  distribution  of  TBF  standard  deviation, 
etc.).  The  Bayesian  approach: 

>  Refines  estimate  by  progressively  collecting  data  on  a 
“as  needed”  basis. 


>  Allows  fusion  of  available  data  with  “expert”  opinion. 
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Group  LI 


Notation 


Original  data  Updated  data 

Vehicle#  mileage  Vehicle#  mileage 


10 

741 

1 

10247 

4 

5273 

2 

9044 

7 

6027 

2 

8977 

5 

7398 

3 

13984 

6 

7495 

3 

4064 

2 

9044 

4 

5273 

1 

10247 

4 

9747 

8 

12008 

5 

7398 

7 

12011 

5 

7611 

9 

12014 

6 

7495 

10 

12074 

6 

7516 

3 

13984 

7 

6027 

5 

15009 

7 

5984 

6 

15011 

7 

5373 

4 

15020 

8 

12008 

7 

17384 

9 

12014 

2 

3 


18021 

18048 


10 

10 


741 

11333 


Time  Between  Failures 
(TBF) 
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6027 


12011  17384 


20000 


6027 


5984 


5373 
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Observation  /  Assumption 


d  M 


d  M. 

^4- 


M. 


0 


M 


d  M 
* - 


tailed 


d 


1 


M 


i-1 


M 


M 


M 


M 


tailed 


threshold 


dM i  =  Xt  ~  J3{A,  B,  p,  q),  (A  <  X .  <  B,  and  p  >  0,  q  >  0) 


f{x,A,B,p,q)=p{p,q]l{x  —  A)p  *(S  —  xf  1/(B  —  A),,+c'  1  ,  (A<  x<  B,  and  p>0,q>0) 


Beta  Distribution 


C 

o 


2  “ 
^  c 
0)  o 

■s  ° 
ro  c 

H 

o 


A  =  0 

B  =  45,000  miles 
p  =  3,  q  =  5 
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Observation  /  Assumption 


Beta  distribution  family  is  used  to  model  TBF. 


Beta  distributed  PDF 


A=0,  B  =  30000 

f{x,A,B,p,q)=p(p,q )  1  (x-  A)p  l(B-x)q  1  /{B-  A)p+q  1 ,  (A<  x<  B,  and  p  >  0,  q  >  0) 
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MLE  Approach 


Determines  parameters  (A,  B,  p,  q )  of  “most  likely”  Beta 
distribution  using  available  data.  It  provides  Likelihood 
function  in  Bayesian  estimation. 

Censored  MLE 


#  of  recorded 
failures 


A 


#  of  survivals 


Max  iiv'  ''•••••  -nt 

j= i  \ 


A,B,p,q 


Beta  PDF 


Beta  CDF 


Uncensored  MLE 


N 


Max  T\f(xi’A,B,p,q) 

A,B,p,q 


UNCLASSIFIED:  Dist  A.  Approved  for  public  release 


25 


> 

Oakland 

LfrftfRJTY 


Bayesian  Updating 

>  Progressively  updates  estimated  Beta  parameters  (A,  B, 
p,  q )  using  prior  knowledge  and  available  new  data. 

>  It  allows  to  “fuse”  available  data  with  expert  opinion. 


where: 

DA  TA  =  {DA  TA /  DA  TAX 


failures  survivals 

F  _  ,TAS 


and 


Np  Ns  r  / 

L(0  /  D AT A)  =  L(0  /  DATAf  )l(0  /  DATAS )  =  n/MOMMJ 


i=\ 


7=1 


UNCLASSIFIED:  Dist  A.  Approved  for  public  release 


26 


Oakland 


UN\fKgTY 


Censored  MLE  Approach  (Method  1) 


1.  Enter  recorded  failure  data 

2.  Data  sorting 

3.  Histogram  of  recorded  failure  data 

4.  Maximum  Likelihood  Estimation  (MLE)  with 
censored  data 

5.  Tail  sampling  to  get  inferred  failure  mileage 

6.  Histogram  of  both  recorded  and  tailed  failure  data 

7.  MLE  with  uncensored  data  (considering  tailed  data) 

8.  Failure  probability  bounds  are  calculated  by 
Bootstrap  method 
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Censored  MLE  Approach  (Method  1) 


1.  Enter  recorded  failure  data 


•  Artificial  data  used:  15  vehicles,  4  tires  each  side, 

•  ^threshold  =30,000  miles 

•  Beta  distribution:  A=0,  Z?=45,000,/>  =  3,  and  q  =  5 

d Mj  =  Xt  ~  fi{A,  B,  p,  q\  (A  <  Xt  <  B,  and  p  >  0,  q  >  0) 
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Censored  MLE  Approach  (Method  1) 


2.  Data  sorting 

>  Sort  recorded  failure  data  (white  cells) 

>  Retrieve  “failure  mileage”  data  (164)  and  “survival 
mileage”  data  (120) 


A 

B 

C 

D 

E 

F 

m 

H 

1 

J 

K 

L 

1 

procedure" 

Method 

Counts 

Counts 

Buttons 

Options 

Survivals 

2 

1 

161 

164 

!  Data  Sorting  | 

0 

120 

3 

Tail  Sampling 

0 

4 

^threshold 

30000 

Recorded  Failure  Data 

Sorted  Failure  Data 

Survival  Data 

5 

Vehicle  No.  ” 

Tire  Location'1 

Odometer  Mileage"1 

Failure  Mode"" 

Vehicle"" 

Tire 

Odometer  Mileage” 

Failure  Mode” 

Failure  Mileage” 

Survival  Mileage” 

Tailed  Failure  Mileage” 

6 

7 

L4 

21764.88086 

WO 

1 

LI 

7921 

WO 

7921 

7 

4 

R1 

25169.7207 

WO 

1 

LI 

27055 

WO 

19134 

2945 

8 

12 

R2 

19132.91602 

WO 

1 

L2 

13983 

wo 

13983 

16017 

9 

6 

LI 

18305.94727 

WO 

1 

L3 

8999 

wo 

8999 

10 

5 

R2 

28231.19336 

WO 

1 

L3 

26431 

wo 

17432 

3569 

11 

5 

L3 

10868.71875 

WO 

1 

L4 

9961 

wo 

9961 

12 

15 

L3 

19211.23633 

WO 

1 

L4 

24638 

wo 

14677 

5362 

13 

8 

R3 

14433.77148 

WO 

1 

R1 

21269 

wo 

21269 

14 

13 

L4 

10622.08398 

WO 

1 

R1 

28519 

RH 

7250 

1481 

15 

10 

L2 

11497.66406 

WO 

1 

R2 

20666 

WO 

20666 

9334 

16 

1 

R4 

13365.61914 

RH 

1 

R3 

16643 

WO 

16643 

17 

12 

L4 

19039.30664 

WO 

1 

R3 

24985 

WO 

8342 

5015 

m  i  ►  m  \  Demo  Data  /Failure  Data/  Data  Analysis  /  Beta  Dist  /  Resampling  Tab  /  Bayesian  Updating  /  GA  Solver  /  output  generations  /  warnings  /|<|  |  >\ 
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Censored  MLE  Approach  (Method  1)  ||| 


3.  Histogram  of  recorded  failure  data 

•  Considers  failure  mileage  data 

•  DOES  NOT  consider  survival  mileage  data 

•  Histogram  shape  may  change  with  different  number  of  bins  and  ranges 


Histogram,  PDF,  and  CDF  of  the  failure  data 


A 

B 

c 

D 

i 

Vehicle’' 

Tire’' 

Mileage' 
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2 

1 

LI 

7921 

WO  I 

3 

1 

LI 

19134 

WO 

4 

1 

L2 

13983 

wo 

5 

1 

L3 

8999 

wo 

6 

1 

L3 

17432 

wo 

7 

1 

L4 

9961 

wo 

8 

1 

L4 

14677 

wo 

9 

1 

R1 

21269 

wo 

10 
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R1 

7250 

RH 

11 

1 

R2 

20666 

WO 

12 

1 

R3 

16643 

WO 

13 

1 

R3 

8342 

WO 

14 

1 

R4 

13366 

RH 

15 

1 

R4 

16564 

RH 

16 

2 

LI 

23863 

RH 

17 

2 

L2 

15470 

WO 

18 

2 

L3 

12651 

WO 

a 

_ ^ 

1  A 

AAA  OO 

i 

1  F  1 

I  Failures  | 


H 


I 


K 


M 


Survivals 


PROCEDURE 


Min  Mileage  |  Max  Mileage  |  Mean 


Std  Dev  Skewness  Kurtosis  Confidence  Level 


Resamplings' 


T 


30000 


14958  5842 


.2655  41.3547 


0.9 


5000 


Histogram  j  Param  Estimates  (Likelihood) 


Histogram 


& 

s 

a) 


Tire  failure  Mileage 


Probability  Density  Function  (PDF) 

1.2E-04 


H  <  ► 


:  LJ  I /DP  I  VVU  I.ZC-U4  -I - 1 - 1 

i  _ i _ » _ _ aaa  nn  J _ i  _  _ see _ ^  nr-  r>  *  I  _ _ 1  -  -  llfltfl  I 

►i  \  Demo  Data  /  Failure  Data  \Data  Analysis  /  Beta  Dist  /  Resampling  Tab 


Param  Estimates  (Explicit) 


Bootstrap 


Bayesian  Update 


No.  of  Bins 

30 

Distrib.  Type" 
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Censored  MLE  Approach  (Method  1) 
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Censored  MLE  Approach  (Method  1) 

Maximum  Likelihood  Estimation  (MLE)  with  censored  data 

•  Considers  failure  mileage  data 

•  CONSIDERS  survival  mileage  data  as  “censored”  data 

•  The  beta  distributed  CDF  by  MLE  with  censored  data,  shows  that  the 
CDF  without  survival  mileage  data  is  left-biased 
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Censored  MLE  Approach  (Method  1) 


5.  Tail  sampling  to  get  inferred  failure  mileage 


•  Tailed  failure  mileage  data  represents  inferred  failure 
mileage  data  of  the  “survived”  tires 
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Censored  MLE  Approach  (Method  1) 


6.  Histogram  of  both  recorded  and  tailed  failure  data 

•  Includes  failure  mileage  data 

•  Includes  also  tailed  failure  mileage  data 

•  The  “tailed”  samples  may  go  beyond 
the  threshold  mileage  of  30,000 

•  MLE  with  censored  data  fits  a  beta 
distributed  CD]  to  sample  data  with 
tailed  mileage 
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Censored  MLE  Approach  (Method  1) 


7.  MLE  with  uncensored  data  considering  tailed 
failure  data 


•  Includes  both  recorded  failure  data  and  “tailed”  data 

•  Using  MLE  with  uncensored  data,  a  beta  distributed 
CD]  is  fitted  to  the  recorded  and  “tailed”  data 


•  F ailure  probability  is  calculated 
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Censored  MLE  Approach  (Method  1) 


8.  Failure  probability  bounds  are  calculated  using  Bootstrap 

•  Both  recorded  and  “tailed”  data  are  used. 

•  5000  samples  (sets  of  sample  points)  are  randomly  generated 
from  the  recorded  and  “tailed”  sample. 

•  Failure  probability  bounds  with  confident  level  of  0.9  are 
calculated. 

•  Statistics  of  other  parameters  are  provided  (mean  of  failure 
mileage,  std  dev  of  failure  mileage,  parameters  p  and  q ,  and 
probability  of  failure). 
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Censored  MLE  Approach  (Method  1) 


Std  Dev  of  failure  mileage 
Histogram 
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Mean  of  failure  mileage  Histogram 
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Censored  MLE  Approach  (Method  1) 


Probability  of  failure  Histogram 
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Bayesian  Updating  Approach  (Method  2) 


>  Specify  “PRIOR”  distribution 

>  Calculate  “LIKELIHOOD”  distribution 

>  Calculate  “POSTERIOR”  distribution 
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Bayesian  Updating  Approach  (Method  2) 


1.  Specify  “PRIOR”  distribution 

■  “PRIOR  source”  Option  0:  Uniform  (non-informative)  distribution 

■  “PRIOR  source”  Option  3:  Normal  distribution  for  each  parameter 

—  Expert  opinion 
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Bayesian  Updating  Approach  (Method  2) 


1.  Specify  “PRIOR”  distribution  (Cont’d) 

■  “Updated  Parameter  Distribution  Table”  and  2-D  Diagram 

■  “PRIOR  source”  option  is  automatically  set  to  1 
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Bayesian  Updating  Approach  (Method  2) 


2.  Calculate  “LIKELIHOOD”  distribution 

‘Updated  Parameter  Distribution  Table”  and  2-D  Diagram 
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3.  Calculate  “POSTERIOR”  distribution 

‘Updated  Parameter  Distribution  Table”  and  2-D  Diagram 
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3. 


Bayesian  Updating  Approach  (Method  2) 

Calculate  “POSTERIOR”  distribution  (Cont’d) 

■  Updated  “PRIOR  source” 

■  Best  estimated  (most  probable)  parameters  (peak  point  of 
posterior  distribution) 

■  Means  and  stand,  deviations  of  parameters;  Obtained  by 
sampling  posterior  5000  times 

■  Ranges  (min,  max)  of  parameters 
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THEORY 
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Reset 
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You're  updating  tfte  parameters 


st  time: 


_ _ _ _ _  _ _  _  — _ _ 

H  i  ►  H  \  Demo  Data  /  Failure  Data  /  Data  Analysis  /  Beta  Dist  /  Resampling  Tab  Bayesian  Updating  /  GA  Solver  /  output  generations  /  warnings  /  |<|  |  t| 
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Bayesian  Updating  Approach  (Method  2) 

3.  Calculate  “POSTERIOR”  distribution  (Cont’d) 

■  PDF  and  CDF  of  Failure  Probability  and  Its  Bounds  (sampling 
posterior  5000  times) 


Probability  Density  Function  (PDF) 
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Cumulative  Distribution  Function  (CDF) 
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Failure  Probability  and  Its  Bounds 
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Summary 


Two  methods  have  been  presented  to 
estimate  statistics  of  Time  Between 
Failures  (TBF)  using  limited,  censored 
data 

•  Censored  MLE  approach  (Method  1) 

•  Bayesian  updating  approach  (Method  2) 

S  “Enhances”  data  with  expert  opinion 
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Potential  Developments  in 
Durability,  Reliability, 
Availability  and  Maintainability 
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System  (Vehicle)  Reliability 


> 
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Vehicle 

TTF 


Histogram 


D 
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System  (Vehicle) 
Reliability 


i  Monte  Carlo 
Simulation 
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For  Vehicle : 


MTBF  = 


=  |  R(t)dt 
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Reliability  Allocation 


Optimization 


This  optimization  problem  DOES  NOT 
have  a  unique  solution 
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Reliability  Allocation 


One  way  to  get  a  unique  solution  is  to  trade-off 
reliability  and  associated  cost 


min  Cost 


D 

—comp 


Target  system 
reliability 


s.  t.  System  Re  liability  =  R 


/ 
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Reliability  vs  Risk  of  Failure  (Cost) 


We  want  to  maximize  Reliability  and  simultaneously 

minimize  Risk  of  failure  (cost) 


R‘ 


#  Utopia 

Pt  x* 


Pareto  Front 


F easible  Domain 


Cost 
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Putting  it  All  Together  !!! 

Minimum-F  ailure-F  ree-Operating 


Uptime 


Downtime 

i 


Period 

/ 

MFFOP 


0 


-a 


/ 


Failure 


P mffop  :  Probability  of 
achieving  MFFOP 


Determine  component  hazard  rates  to: 
>  Max  Reliability 


time 


>  Min  Cost  Availability 

>  Max  Availability 


>  Max  MFFOP 

>  ... 


Multi-Objective 

Optimization 


E\Uptime\ 


E\Uptime\  +  E[Downtime\ 
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